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FIG. 2A 
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FIG. 2B 
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Capturing a Plurality of Real-Time Video Streams of a 
Local Participant From a Plurality of Camera 
Viewpoints 
310 



Generating Real-Time Renderings of tlie Local 
Participant Based on the Plurality of Real-Time Video 
Streams by Applying a New View Synthesis Technique, 
Wherein the Real-Time Renderings are Taken From a 
Perspective of a Remote Participant Located Remotely 
in the Gaming Environment 
320 

i 

Sending the Real-Time Renderings to the Remote 
Participant for Viewing Within the Gaming 
Environment 
330 
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Generating the Real-Time Renderings from a 
Perspective Taken From a Second Location of tlie 
Remote Participant with Respect to a First Location of 
the Local Participant Within a Coordinate Space of the 
Virtual Gaming Environment 
340 

i 

Enabling a Change in at Least One of the First and 
Second Locations by Allowing the Local Participant 
and the Remote Participant to Navigate Through the 
Coordinate Space of the Virtual Gaming Environment 
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Modifying the Real-Time Renderings to Reflect the 
Change in at Least One of the First and Second 

Locations 
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Blending the Real-Time Rendering Within a Synthetic 
Rendering of the Virtual Gaming Environment 

370 
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Displaying the Real-Time Renderings Within the Virtual 
Gaming Environment at a Display Viewable by 
the Second Participant to Enable Real-Time Video 
Communication Between the Local Participant and 
the Remote Participant Within the Gaming 
Environment 
380 
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Capturing a Plurality of Real-Time Video Streams of a 
Local Participant From a Plurality of Camera 
Viewpoints 
4111 

i 

Generating a Video Image Stream in Real-Time of the 
Local Participant Based on the Plurality of Real-Time 
Video Streams by Applying a New View Synthesis 
Technique, Wherein the Video Image Stream is 
Rendered from a Perspective of a Remote Participant 
Located Remotely in the Gaming Environment 

420 

i 

Incorporating the Video Image Stream Comprising 
Real-Time Photorealistic Features of the Local 
Participant into a Graphically Generated Avatar, 

Wherein the Graphically Generated Avatar 
Represents the Local Participant in the Gaming 
Environment from a Perspective Associated with the 
Remote Participant 
430 
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